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NThls  atudy  exaalnaa  the  Army* a lataat  effort  In 
executive  appraisal  in  terms  of  applicability  to  reserve 
component  offioere.  Conducted  while  a proposed  revision  of 
the  Officer  Evaluation  System  was  being  tested,  the  in- 
vestigation focused  on  problems  associated  with  duty-time 
limitations  that  ni^d^t  adversely  affect  the  implementation 
of  a system  inooxrporat ing  concepts  related  to  management  by 
objective— and  Tdilch  Involves  extensive  on-going  communi- 
cation between  rater  and  rated  officer.  Following  a se- 
lected review  of  the  literature  dealing  with  executive 
appraisal,  the  question  was  explored  in  a series  of  indi- 
vidual and  group  interviews  with  23  reserve  component 
officers  in  the  grades  of  captain  through  brigadier  general. 
Additional  input  came  from  two  recently  retired  senior 
officers  who  are  now  members  of  a university  faculty  in 
management  science.  The  results  were  favorable  frcw  the 
standpoint  of  applicability » moreover.  Indications  were  the 
system  was  recognized  as  having  considerable  merit  euid  would 
be  well  received. 
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THB  PROBLEM  IN  ITS  BACKGROUND  SETTING 

SoB«  might  find  it  «nrprl8lng  to  l««m  that  it  ifas  the 
military  mhioh  developed  the  first  workable  perfomance- 
rating  system.  Indeed,  more  than  80  years  ago  President 
Beniamin  Hazrison  was  so  impressed  with  it  that  he  directed 
the  oiTilian  agencies  of  the  government  to  adopt  a similar 
system.^  No  matter  how  good  the  military  might  have  been  at 
executive  appraisal  near  the  close  of  the  nineteenth  century, 
numerous  studies  and  the  introduction  of  eight  new  evaluation 
instruments  within  the  last  30  years  point  out  it  is  not  so 
today. 

A 197^  group  researoh  project  oonduoted  by  students  at 
the  Army  War  College  under  the  leadership  of  Colonel  Dan- 
dridge  M.  Metlone  of  the  College  faculty  appears  to  have  un- 
covered a most  significant  reason  for  reoent  failures  in  the 
system.  This  group  determined  the  root  problem  to  be  one  of 
a laok  of  oonfldenoe  in  the  system  by  the  Officer  Corps,  and 
statedi 


Quantitative  and  qualitative  data  indicate 
olearly  that  officer  oonfldenoe  in  OBS  is 
low.  They  also  suggest  strongly  that  var- 
iances in  rating  behavior,  whioh  stem  from 
the  many  complex  pressures  and  influences 
that  make  up  the  rating  environment,  may 
oause  this  laok  of  confidence.  As  a mini- 
mum, oonfldenoe  and  rater  behavior  react 
on  each  other.  Out  of  these  interactions 
come  more  varianoe  in  rating  behavior  and 
deoreased  oonfldenoe  in  the  system.  Sup- 
porting these  indioat ions  is  the  dooumen- 
tary  finding  that  the  Amy  never  has 
designed  a strategy  to  oreate  and  maintain 
officer  oonfldenoe  in  the  OBS.  Meanwhile, 
the  wreckage  of  seven  OBS  forms  and  the 
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pending  orash  of  the  eighth  argue  strongly 
that,  without  the  confidence  and  acceptance 
of  officers  affected,  no  0B8  will  wozte  ef- 
f eotirely. 2 

Rather  as  an  outgrowth  of  the  study  just  cited  or  for 
reasons  unknown  to  this  writer,  the  fact  is  that  the  inay*s 
Personnel  Bwaluation  Systeas  Office  has  in  the  last  year  de- 
veloped a new  instrument  that  will  not  only  address  but  hope- 
fully begin  to  resolve  the  problem  with  confidence.  The  new 
instrument,  DA  Form  76,  essentially  incorporates  the  concept 
of  management  by  objective,  or  HBO,  as  it  is  commonly  known— 
althou^  that  particular  terminology  is  not  used.  It  is  en- 
visioned as  the  first  in  a series  of  evolutionary  steps  which 
recognizes  the  histoiry  and  present  state  of  officer  evaluation, 
and  considers  developments  in  personnel  evaluation,  systeas 
outside  the  Army, ^ 

The  central  focus  in  this  concept  is  the  communication 
process  between  rater  and  rated  officer.  As  envisioned,  an 
officer *s  specific  job  is  defined  in  a before  the  fact  dis- 
cussion with  his  rater  in  which  the  rated  officer  has  an 
opportunity  to  influence  the  scope  of  his  duties.  Moreover, 
there  is  a degree  of  mutual  agreement  between  the  two  as  per- 
formance objectives  that  will  bear  on  the  aocoaplishaent  of 
these  duties  are  established.  Continued  cosnunication  during 
the  rating  period  is  called  for  as  revision  and  update  of  job 
description  and  performance  objectives  becomes  necessary. 
Finally,  there  is  after  the  fact  enumeration  of  that  which 
took  place. 
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Xt  Is  iaportsnt  to  nots  that  it  is  tho  xmtsd  offiosr 


hlnsslf  who  ooaplstss  thsss  portions  of  ths  rsporti  ths 
ratsr,  indorser,  end  reviewer  will  oooaent  on  these  points 
in  other  sections.  A reproduction  of  DA  Pom  7<S  (test)  will 
be  found  st  Appendix  A. 

In  industry,  the  focus  on  HBO  tends  tc  be  on  s quenti> 
tetive  niessurement  of  how  well  en  executive  hes  net  his  goals 
or  performance  objectives.  Initially,  the  Army's  concept  is 
to  focus  on  oommunioatir'n  and  befor^and  agreement  on  one's 
Job  description,  and  the  establishment  of  objectives  or  a 
plan  for  carrying  out  the  tasks. ^ With  this  in  mind,  DA  Form 
76  was  implemented  for  test  purposes  by  seleoted  units  on 
1 October  1975. 

The  larger  question  to  be  answered  by  the  test  will  have 
to  do  with  whether  or  not  this  approach  is  good  for  the  Army 
as  a whole.  With  the  great  emphasis  on  before,  during,  and 
after  the  fact  conmunioation  between  rated  officer  and  rater-- 
and  with  the  ’limited  duty  time  available  to  implement  or  ob- 
serve progress  toward  accomplishment  of  objectives— the  con- 
cept niedit  pnove  unwieldly  and  impraotical  within  reserve 
components,  erren  if  found  acceptable  otherwise.  Accordingly, 
the  specific  purpose  of  this  investigation  was  to  determine 
the  applicability  within  reserve  components  of  the  HBO  pro- 
cess in  the  revised  Officer  Bvalnation  System  (OBS) . 

LITBRATURB  BBVIBW 

Over  the  years  there  have  been  periodic  investigations 
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of  th«  OES.  Th«  foous  of  two  r«e»nt  studios  t«nd«d  to  bo  on 
ths  sffioaoy  of  the  Officer  Bffioieaoy  Report  (OBR)  then  in 
use.  These  studies  did,  however,  begin  to  point  out  factors 
which  bear  on  the  problen  of  lack  of  confidence  in  the  eystea 
tqr  the  Officer  Corps.  Thus,  in  a I969  study  we  find  a call 
for  rater  training  and  for  showing  the  report  to  the  rated 
offioer^-the  latter  of  which  is  now  a part  of  the  system.  A 
more  recent  study  addressing  evaluation,  inflation,  and  order 
of  merit  points  out  that  many  officers  do  not  understand  the 
subleties  of  numerically  wei^ted  scoring  systems.^ 

A 1973  research  paper  published  at  the  Army  War  College 
spoke  of  inconsistencies  in  assigning  order  of  merit  for  pro- 
motion and  of  unintentional  bias.  It  repozrted  the  results  of 
a test  using  groups  of  students  at  the  College  to  evaluate 
the  files  of  officers  recently  considered  by  promotion  boards. 
Although  there  was  a high  oorrelation  between  the  student 
"boards”  and  the  actual  boards  with  those  clearly  above  and 
clearly  below  average,  there  was  much  inconsistency  when  con- 
sidering the  files  of  those  at  the  borderline.  These  inveat- 
if^aters  found  that  by  using  regression  analysis  techniques  in 
a data  processing  system,  inconsistencies  anl  bias  oould  be 
substantially  reduced.^ 

Investigations  such  as  these  did  not,  however,  provide 
real  background  for  development  of  a.  new  approach.  They 
tended  to  find  eomething  was  wrong,  but  for  a concept  of 
exeoutive  appraisal  that  mi£^t  answer  the  complaint e and 
prove  to  be  effective;  the  Army  had  to  look  to  industry. 
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Thero,  the  need  for  perforaenoe  eTaluatlon  (or  idiat  might  be 
deeorlbed  as  how  well  perfoxinanoe  object  Ires  are  met)  Is  just 
about  universally  aooepted  in  the  business  world It  seats 
reasonable  to  assume  that  an  approach  so  aooepted  must  have 
support  from  the  exooutiTe  oommunity  in  general,  and  by  and 
large,  this  oonoept  embodies  the  idea  of  MBO. 

This  conoept  was  first  advanced  a little  more  than  20 
years  ago  by  Peter  P.  Druoker,  who  is  recognized  as  one  of 
the  leading-»many  would  say  the  foremost  of->*management  con- 
sultants in  the  country*  Writing  in  195^,  Druoker  saidt 

Each  manager  from  tiie  "big  boss"  down  to 
the  production  foreman  or  the  chief  clerk, 
needs  clearly  spelled-out  objectives* 

These  objectives  should  lay  out  what  per- 
formanoe  the  man's  own  managerial  unit  is 
supposed  to  produce*  They  should  lay  out 
shat  contribution  he  and  his  unit  are  ez- 
peoted  to  make  to  help  other  units  obtain 
their  objectives*  Finally,  they  should 
spell  out  what  oontribution  the  manager 
can  expect  from  other  units  toward  the 
attainment  of  his  own  objectives* 10 

Continuing,  Druoker  said  that  by  definition  a manager  is 
responsible  for  the  oontribution  his  particular  segment  of 
the  operation  makes  to  the  larger  unit  above  him— that  his 
performance  obflectlves  aim  upward*  This,  in  turn,  requires 
that  each  manager  devise  his  own  objectives,  although  higher 
nanageaent  legitimately  will  exercise  approval  authority. 

Before  one  can  really  set  perforaanoe  objectives,  how- 
ever, he  auet  first  know  just  what  is  included  in  his  jobt 
1.  e*,  there  must  be  a speoifio  and  realistic  job  desoription* 
Too  often  in  the  Army  there  has  been  management  by  "oricie," 
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or  roaetion  to  th«  latoat  "flap,"  with  offioara  haring  tasks 
thrust  upon  thsia  with  llttlo  guidanos  and  at  Isast  a partial 
laok  of  undsrstanding  as  to  shat  is  ezpsotsd.  Draoksr  and 
othsrs  with  export iss  in  the  field  say  this  is  not  the  way  to 
manage,  suid  while  pressure  situations  oalling  for  some  flexi- 
bility will  always  arise,  a olear-out  Job  description  from 
which  perfoxmanoe  objectives  are  derived  will  serve  to  main- 
tain perspective  and  enhance  honest  appraisal.  One  author 
expressed  the  latter  thought  in  reverse  by  pointing  out  that 
too  often  Jobs  aren't  sufficiently  defined  to  allow  for  pro- 
per aval uat ion. 

Job  description  is  not  an  area  in  which  industry  has  al- 
ways excelled,  but  it  has  come  to  be  recognised  as  a first 
critical  step.  The  supervising  manager  (or  oommander)  must 
assign  responsibility  for  the  major  tasks  or  activities  to  a 
subordinate  and  he  must  clarify  interfaces  and  work  relation- 
ships. Traditionally.  Job  descriptions  have  been  broad 
statements  of  that  which  was  expected,  and  have  not  adequately 
described  the  nature  of  the  interfaces  between  one  manager  and 
another. In  an  introductory  work  in  social  technology. 
Varela  listed  the  develoiment  of  a Job  description  and  speci- 
fication sheet  as  the  first  step  in  the  method  leading  to  the 
appraisal  of  one's  performance.^^  In  the  revised  OBS.  as  in- 
dioated  earlier,  it  is  expected  that  the  rated  officer  will 
have  an  opportunity  to  influence  that  whioh  is  included  as  he 
develops  his  Job  description  with  his  rater. 

It  mi£d^t  be  noted  here  that  keeping  on  the  track  with 
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nhat  one  ehould  be  doing  in  relation  to  hie  Job  description 
is  moat  important  aa  well.  The  problem  of  diatraotion  may  be 
more  preralent  at  the  upper  end  of  the  exeoutiTe  scale  where 
there  is  less  of  a struoturitd  situation,  but  all  need  to  be 
alert  to  it.  A Swedish  management  consultant  by  the  name  of 
Hindersson  has  iswen  gone  so  far  as  to  invent  an  electronic 
devise  which  some  800  European  executives  are  using  to  analyze 
what  they  are  doing.  The  device  is  programed  to  "beep”  about 
30  times  a day  at  random,  at  which  time  four  to  ten  recorded 
questions  are  posed  concerning  the  executive's  activity  at 
that  moment— to  which  he  responds  on  a tape  recorder, 

Army  officers  may  not  need  Hindersson* s approach  (indeed* 
it  would  hardly  be  practical  in  the  field) , but  they  do  need 
to  have  more  clearly  defined  duties  and  to  focus  on  them. 

There  is  every  reason  to  thiidc  that  such  a management  prac- 
tice will  enhance  mission  aooomplishment  in  the  Army  as  in 
Industry.  Moreover,  it  is  the  first  step  toward  an  evalu- 
ation system  that  will  really  describe  an  officer  and  how  he 
gets  his  job  done. 

The  essence  cf  MBO  are  the  objectives,  laid  out— as 
Druoker  said— to  identify  to  the  manager  that  which  his  own 
unit  should  produce,  the  contribution  his  unit  is  expected  to 
make  in  helping  other  units  obtain  their  objectives,  and  to 
indicate  the  contribution  the  manager  can  expect  from  other 
units  toward  his  objectives.  The  developers  of  AA  Pom  76 
see  four  categories  of  objeotivesi  routine,  problem  solving, 
inovatlve,  and  personal  development.  These  categories,  in- 
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oldentalljr,  oonform  to  those  Hals  cites  In  hie  recent  work  on 
MBO,  althoush  he  tends  to  combine  the  problem  solving  with 
the  InnoTStlTe.^^  While  not  mandatory.  Ideally  an  officer 
will  select  at  least  one  objective  from  each  category. How 
well  one  meets  his  objectives  has  much  to  do  with  the  organi- 
zation's mission  aocompllsliment,  and  obviously  provides  a 
more  clear  cut  standard  by  which  his  managerial  effort  can  be 
appraised. 

Some  mli^t  complain  that  an  OES  without  numbers  to  desig- 
nate the  quality  of  performance  tends  to  cure  Inflated 
ratings  In  much  the  same  manner  as  cutting  off  one's  head 
would  cure  a headache.  We  must  therefore  examine  idiat  soiie 
of  those  with  expeastita  in  management  have  to  say  about  the 
MBO  approach  to  executive  appraisal  in  contrast  to  earlier 
systems. 

Characterized  by  rating  scales  and  global  observations, 
or  overall  Impressions  which  cover  up  much,  the  traditional 
anoroaoh  represents  a ” check  list"  of  whit  Is  thought  to  be 
the  most  critical  areas  of  managerial  behavior.  Commenting 
on  this,  Campbell  saidi  "Unfortunately,  there  is  a rather 
long  and  sorry  history  of  gallant  but  essentially  falling 
efforts  to  develop  rating  scales  for  observing  and  measuring 
Job  behavior."^®  He  further  observed  that  the  smales  de- 
veloped have  given  too  little  attention  to  meanlngfulness, 
behavior  definition,  amd  semantic  clarity,  with  the  result 
they  have  not  been  understood,  or  were  viewed  as  Irrelevant 
by  those  who  had  to  use  them, 
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with  lncoBipl«t«  or  •rroneou*  Job  description*,  of  ne- 
cessity obssTTstions  hare  been  faulty}  and  Inadequate  sampling 
of  Job  beharlor  ha*  been  one  of  the  major  error*.  Still  other 
frequent  errors  sound  like  a summary  of  OBR  complaints,  in- 
oludingi  lack  of  disorimination,  leniency,  halo  effect,  and 
highly  Tarlable  and  inconsistent  responses.  Yet  another  of 
the  traditional  measures  coming  under  fire  has  to  do  with  em- 
ployee attitudes  as  depicted  by  absence  rates,  turnorer,  and 
grievances  (or  their  military  equivalents  in  AWOL,  sick  call, 
and  courts  martial  rates).  Their  deficiency  is  they  cover 
only  a small  portion  of  the  variance  due  to  managerial  be- 
havior and  the  variations  are  dependent  on  many  Job- irrele- 
vant factors  not  under  the  manager's  direct  control. 

Turning  to  the  IfBO  approach,  in  one  of  his  later  works 
Oruoker  said  that  performance  is  all  one  can  or  should  measure. 
As  for  evaluating  potential,  he  noted  that  experienced  people 
have  learned  one  cannot  appraise  it  for  any  length  of  time 
ahead  or  for  anything  very  different  from  what  a nan  is  al- 
ready doing.  He  indicates  that  effective  executives  focus 
on  strengths— on  what  a person  can  do— and  points  out  that 
such  an  executive  knows  that  to  get  strength  one  has  to  put 
up  with  weakness.  Drueker  does,  however,  provide  for  atten- 
tion to  character  weakness  in  appraisal,  as  he  observes  that 
a corrupt  executive  destroys  an  organisation.^^ 

More  or  less  Joining  Bruoker  in  acknowledging  the  need 
for  an  evaluation  of  character  strengths  and  weaknesses,  a 
director  of  a number  of  corporations  indicated  that  rating  an 
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exaoutlTo  reqairos  two  approaoheB>-that  of  moasurln^  how  well 
he  meets  object Ivee  and  how  he  measures  up  as  a man.^^  Thus, 
It  would  seem  that  at  least  some  of  the  items  in  Section  1 of 
Part  IV  of  DA  Form  76  are  appropriate  as  they  relate  to  the 
professional  code  of  an  offioer— -even  though  the  section  has 
the  appearance  and  perhaps  in  part  the  deficiencies  of  the 
traditional  "ohook  list.** 

At  the  outset  of  this  essay  the  writer  referred  to  the 
finding  of  a researoh  group  directed  by  Colonel  D,  M,  Halone 
to  the  effect  that  a lack  of  confidence  in  the  OES  was  at  the 
heart  of  the  problem  with  the  various  instruments  the  Army  has 
used  to  appraise  its  officers.  That  group »s  recommendation 
to  design  and  Implement  a strategy  to  create  oonfidmnoe  In 
and  acceptance  of  the  systmt  spoke  of  several  points  it  felt 
would  have  to  be  included.  These  were  the  establishment  of 
standards  along  with  controls  to  insure  they  were  met,  edu- 
cating the  officers  to  the  point  all  really  knew  the  system 
and  their  responsibility  to  It,  and  strict  enforcement  of  the 
system. Writing  in  Personnel  Journal.  Hoyden  would  seem  to 
support  this  reo<M&mendatlon  as  he  addressed  the  subject  of 
training  of  raters  as  followsi 

Xt  is  clearly  insuffioient  to  install. a 
new  appraisal  system  by  distributing 
the  new  evaluation  forms. .. .those  super- 
<risors  doing  the  rating  amd  all  levels 
of  supervisors  should  be  thoroughly  In*- 
troduosd  to  the  appraisal  systaa.  It  is 
necessary  that  those  supervisors  using 
the  system  understand  the  rationale  upon 
which  the  system  is  based,  the  roles  of 
the  rater  in  the  appraisal  process,  the 
responsibilities  of  the  supervisor,  the 
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appralaal  Interfiaw  process,  and  the  use 
of  the  eraluatlon  lnfon&ation.23 

Elsewhere  in  the  ertlole  Hayden  Bakes  the  point  that 
appraisal  systems  have  a dual  purpose*  They  identify  those 
who  are  good  candidates  for  promotion,  or  ones  to  become  a 
part  of  a reduction  in  force,  or  other  administrative  pur- 
poses requiring  relative  standards.  On  the  other  hand,  such 
systems  have  a role  in  employee  development  or  counseling 
that  requires  an  absolute  standard* , The  author  further  ob- 
serves that  It  is  not  possible  for  the  superviwcr  to  fill  the 
Judicial  and  counseling  roles  simultaneously,  and  that  em- 
ployee development  oounaeling  should  be  taking  place  on  a day 
to  day  basis, These  latter  thoughts  seem  to  be  in  line 
with  those  of  a project  officer  of  the  Army*s  Personnel  Eval- 
uation Systems  Office  as  ho  foresees  the  implementation  of  an 
OES  using.  DA  ?orm  ?6  as  the  reporting  instrument,  l.e*,  a 
focus  o&  frequent  oommunioation  between  rater  and  rated 
officer  to  better  define  one’s  Job,  set  objectives,  and  plan 
for  carrying  out  the  tasks. 

For  those  ffho  might  question— or  st  least  wonder  about— 
the  input  the  rated  officer  will  have  In  this  system,  a com- 
ment from  B.  Newton  Cutler,  Jr. , Senior  Vice  President  of 
First  National  City  Ban)i,  is  appropriate,  Mr.  Cutler  has 
his  subordinates  evaluate  their  own  performance  and  submit 
these  evaluations  to  him  for  final  review.  He  notes:  "It’s 
amazing  how  honest  people  are,  •••  They  put  things  in  that 
are  detrimental  to  their  own  progress  and  promotion. "26 
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Obviously*  Appraisal  systems  enoompasslne  or  closely 
allied  with  the  concept  of  NBO  are  well  supposrted  by  know- 
ledgeable writers.  This  approach  causes  one  to  think  In 
terms  of  priorities  a'j  duty  descriptions  and  objectives  are 
developed*  and  offers  the  further  advantage  of  Impacting 
farrorably  on  mission  accomplishment— or  as  Meyer  stated  Itt 
''Performance  evaluation  Is  being  linked  Increasingly  to  com- 
panies* long-range  planning  efforts. In  short,  the 
Judgment  of  management  consultants  and  the  experience  gained 
using  this  approach  In  the  business  world  provide  a sound 
basis  for  believing  the  current  test  of  DA  Form  ?6  will  prove 
successful  for  the  Army. 

RESEARCH  DESIGN 

If  the  key  to  successful  Implementation  of  a MBO 
oriented  evaluation  system  Is  the  communication  process  be- 
tween rater  and  rated  officer,  and  If  as  Indicated  In  the 
literature  this  Is  a continuing  process,  will  such  a concept 
prove  workable  with  reservists  who  are  bound  by  time  con- 
straints not  applicable  to  the  active  Army?  It  was  apparent 
the  question  of  whether  sufficient  time  Is  available  for 
counseling  and  discussion  of  objectives  In  a reserve  setting 
would  have  to  be  explored.  An  Important  and  related  question 
concerned  time  available  to  accomplish,  or  even  to  Include* 
objectives  from  all  four  categories  as  Is  preferable. 

Recognizing  that  officers  assigned  to  units  performed 
about  three  times  the  amount  of  duty  as  one  assigned  In  a 
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mobilization  oapaoity,  another  question  related  to  this  even 
more  severe  time  constraint  for  the  nonMunlt  officer.  Al- 
though this  question  was  not  ignored,  access  to  a sufficient 
number  of  Mobilization  Designee  officers  was  not  possible! 
thus,  the  study  was  limited  to  the  impact  on  officers  assigned 
to  units. 

Although  the  questions  relative  to  time  appeared  to  be 
key  in  terms  of  determining  the  applicability  of  DA  Foxmi  ?6 
with  reserve  officers,  other  points  merited  attention  as  well. 
Pr<Hii  experience  the  writer  know  that  it  is  common  for  a re- 
serve rater  to  be  called  upon  to  evaluate  an  officer  serving 
in  the  same  capacity  for  two  or  more  annual  rating  periods. 

It  therefore  appeared  logical  to  determine  whether  this  ex- 
posure over  longer  periods  might  impact  favorably  on  use  of 
this  method  of  apx>ral8al. 

Additionally,  some  questions  apply  to  active  and  reserve 
officers  alike.  Included  are  those  of  a more  general  or 
theoretical  nature  that  might  suggest  an  acceptance  of  con- 
cept. Thus,  it  was  approinrlate  to  determine  the  reaction  of 
officers  to  a HBO  approach  to  evaluation. 

The  data  was  collected  primarily  in  interviews  with  re- 
serve component  officers.  A limitation  was  that  those  se- 
lected live  within  the  same  geographic  area  as  the  writer  in 
Northwestern  South  Carolina.  Also,  a scientifically  repre- 
sentative cross  section  was  not  available;  but  officers  of  a 
number  of  branohes  and  representing  a wide  range  of  assign- 
ments are  kioluded. 
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Thrao  Reffulaz*  Army  Officers  also  proTlded  valuable  In- 
I foraatlon.  Initially,  Major  John  D.  Miller  of  the  Personnel 

Evaluation  Systens  Office,  Military  Personnel  Center,  pro- 
vided guidance  In  a telephone  conversation.  He  followed  up 
by  providing  a copy  of  an  early  edition  of  the  developing 
DA  Form  ?6  and  excerpts  from  the  draft  of  the  test  regulation 
that  explained  the  concept  of  the  proposed  OES,  In  a per- 
sonal Interview  he  later  reviewed  some  of  the  data  collected 
to  that  point,  suggested  one  or  two  changes  in  emphasis 
during  the  conduct  of  subsequent  Intervleew,  and  confirmed 
the  writer's  understanding  was  in  line  with  that  envisioned 
by  his  office. 

The  other  two  officers.  Colonel  Thomas  B,  Haert ens  and 
LTC  Claude  3.  Simpson,  Jr.,  retired  from  the  Army  on  31  July 
and  31  August  1975,  respectively.  Both  Immediately  Joined 
the  faoulty/staff  of  the  College  of  Industrial  Management  and 
Textile  Science  at  Clemson  University,  where  they  were  Pro- 
fessor of  Military  Science  (PHS)  and  Deputy  PMS,  respectively, 
for  the  immediately  preceding  three  years.  Colonel  Maertens 
la  a graduate  of  the  Industrial  College  of  the  Armed  Forces 
and  holds  an  advanced  degree  in  management.  Before  Joining 
the  faculty  on  a full-time  basis,  he  had  been  teaching  a 
course  In  manageaent  concurrently  with  his  military  assign- 
ment. LTC  Simpson,  a 1975  graduate  of  the  corresponding 
studies  departaent  of  the  Army  War  College,  holds  an  advanced 
degree  in  counseling  and  Is  now  Assistant  Director  of  Pro- 
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fesslonal  Oevelopment  for  Clemson* 0 management  college 

Ih 


These  gentlemen  were  consulted  as  management  experts  who 
also  have  a thorough  understanding  of  eveGLuation  of  military 
personnel. 

Six  experienced  reserve  component  officers  W|n*e  inter- 
viewed individually  for  approximately  one  hour  each*  The  ob- 
jective in  these  interviews  was  to  probe  in  depth  for  reactions 
after  a careful  explanation  of  the  new  OER  and  its  underlying 
concept* 

Additionally.  15  students  enrolled  in  a USA£  School  ad- 
ministered C&GSC  course  and  their  two  Instructors  were  In- 
cluded in  one  of  two  group  interviews*  A 30  minute  present- 
ation by  the  writer  was  followed  by  a 15  minute  period  in 
which  these  officers  recorded  their  thoughts  on  a.  question- 
naire. The  presentation  consisted  of  an  explanation  of  the 
instructions  in  the  test  regulation*  during  whioh  a trans- 
parency of  the  proposed  OER  was  projected,  as  well  as  pro- 
viding background  information  supporting  this  method  of  eval- 
uation. The  questionnaire  was  modified  for  the  second  of  the 
two  classes,  as  explained  earlier.  A copy  of  the  initial  and 
modified  versions  Is  included  at  Appendixes  B and  C,  respec- 
tively. 

A profile  of  the  23  officers  included  in  the  survey  by 
grade,  component,  type  of  assignment  and  duty,  and  whether 
interviewed  individually  or  in  one  of  the  two  CAGS  class 
groups  is  shown  on  the  following  page. 
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It  might  b®  noted  that  although  only  fir®  officers  are 
ourrently  serrlng  as  oommanders,  almost  all  hare  held  one  or 
more  oommand  assignments  In  the  past.  Vlth  the  exception  of 
a chaplain  (HAJ)  and  one  captain,  all  are  rating  officers 
now,  or  hare  been  such  In  the  recent  past.  They  hare  rated 
a great  number  of  Indlrlduals  during  their  careers-- from  a 
minimum  of  fire  to  In  excess  of  50. 

FINDINGS  AND  DISCUSSION 

The  8ub;)eot  of  this  research  effort  focused  on  deter- 
mining applicability  of  the  rarlsed  OSS  In  the  reserre  com- 
ponents. As  discussed  earlier,  the  stress  on  a communi- 
cation process  between  rater  and  rated  officer  In  relation  to 
time  limitations  gare  rise  to  the  questions  Inrestlgated, 

Of  the  23  officers  surreyed.  19"*' Including  all  six  of 
those  Interrlemed  Indlrldually— reacted  farorably  (11)  or 
most  farorably  (8)  to  this  approach  to  eraluatlon.  Eren 
among  the  four  reacting  unfarorably  there  appeared  to  be  a 
degree  of  ambiguity.  Inasmuch  as  two  indicated  they  per- 
sonally would  like  to  be  rated  by  this  method,  although  they 
considered  It  unlikely  to  work  as  enrisloned.  A third 
officer  Indloated  ha  would  like  to  be  eraluated  under  this 
concept  on  act ire  duty,  though  he  felt  the  procedure  too  In- 
rolred  for  reserrlsts.  Only  the  oaptain  who  has  nerer  serred 
as  a rating  officer  seemed  totally  opposed  to  the  concept. 

The  others  reacting  unfarorably  were  two  more  captains  and 
the  Shaplaln,  1. e. . gentlemen  who  either  had  no  experience  In 
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offioav  eTaluAtion*  or  were  among  the  least  experienced  of 
those  suTTeyed. 

More  partloularly*  as  for  being  able  to  set  obJeotiTos 
in  all  four  oategories  and  oontend  with  limitations  In  this 
or  other  respects  resulting  from  time  constraints,  the 
general  reaction  was  positive.  There  were,  however,  dif- 
ferences in  terms  of  degree. 

Naturally,  the  four  officers  whose  overall  reaction  was 
unfavorable  did  not  think  it  possible  to  set  objectives  in 
all  four  categories t however,  one  of  these  did  not  consider 
time  constraints  to  be  a problem.  His  appraisal  was  one  of 
overall  skepticism,  and  he  viewed  the  whole  of  MBO  as  a fad 
that  would  soon  pass.  Of  the  19  rsaotlng  favorably,  three 
did  indicate  it  would  bo  impossible  to  establish  objectives 
In  all  areas  even  for  a limited  number  of  officers.  Six 
others  expressed  the  opinion  that  the  objectives  would  be 
considerably  more  limited  in  scope  than  for  active  officers, 
but  ten  saw  no  significant  problems  in  implementation.  None 
of  these  19  considered  time  limitations  as  such  to  be  pro- 
hibitive, mlthou^  all  recognized  the  process  to  be  more  time 
consuming  than  aimply  making  an  after  the  fact  evsduation. 

Aside  from  tallies  of  the  reactions,  some  of  the  oom- 
ments  expressed  shed  greater  light  on  "gut  feeliagst"  and 
these  tend  to  have  further  implioations  as  to  aoaeptanoe  and 
confidence  in  the  proposed  OSS.  Thus,  a major  in  a command 
assignment  spoke  to  the  point  of  setting  objeotivss  in  all 
four  areas  as  follows: 

18 


This  Is  already  <l)ns  in  some  fashion  by 
all  good  oomiaandsrs— >and  in  any  case 
should  toe  done,  shether  It  appears  on  a 
report  or  not.  Having  it  on  the  report 
should  have  the  good  effect  of  en- 
couraging the  doing  of  it  ifhere  it  is 
not  being  done,^° 

Similarly,  a National  Guard  battalion  executive  officer 
indicated  his  organization  was  already  involved  in  a pro- 
gram such  as  that  envisioned.  Commenting  on  setting  ob- 
jectives, he  said 9 

My  Group  is  very  actively  Involved  In  an 
MBO  program  which  has  as  one  objective 
providing  information  for  raters  to  make 
fair  decisions.  I have  rated  several 
officers  since  the  program  began  (1  June 
75)  and  have  found  it  very  beneficial. ^9 

Another  major  whose  duty  is  that  of  Secretary  to  the 
General  Staff  of  a division  commented  on  this  point  as 
follows: 


This  is  a must— tends  to  eliminate  the 
dubjeotive.  Forces  the  rater  to  give 
specific  evaluations  on  mutually  agreed 
upon  objectives.  Forces  the  commander  to 
command. 30 

Commenting  on  time  constraints  that  might  place  limi- 
tations on  full  implimentation,  a reserve  major  holding  a 
masters  degree  from  Harvard  University's  School  of  Business 
stated— in  words  to  this  effect— that  such  would  not 
generally  be  a problem.  He  noted  that  raters  would  have 
approximately  40  days  each  year  in  which  to  counsel  with 
rated  officers  and  observe  their  performance.  Moreover,  he 
pointed  out  that  often  the  rater  would  have  aui  officer  as- 
signed to  the  same  duty  for  two  or  three  years,  providing 
an  opportunity  for  long-term  ob<mrvation  in  many  oases.  3l 
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P«rhap8  a National  Guard  battalion  commander  best 
summed  up  thoued^ts  relative  to  this  limitation  when  he  ob- 
served that  time  spent  in  oarxying  out  the  full  scope  of  the 
MBO  process  will  be  better  used  than  muoh  of  that  now  devoted 
to  other  pursuits.  He  elaborated  bj  noting  the  communi- 
cation process  will  cause  raters  to  focus  on  what  they  them- 
selves should  be  doing. 

These  thoughts  fit  well  with  those  of  the  recently  re- 
tired officers  who  are  now  members  of  the  management  faculty/ 
staff  at  Clemson  University.  These  two  agreed  there  is  no 
coni'llot  between  the  MBO  concept  and  its  application  to  part- 
time  employment,  as  it  were.  They  stated  that  MBO  is  a good 
approach  to  evaluating  performance  in  any  job.  As  for  time 
constraints,  they  simply  observed  that  such  was  the  norm  in 
all  military  assignments— active  or  reserve— and  did  not  in- 
validate the  MBO  approach. It  is  also  interesting  to  note 
that  both  indicated  a most  favorable  reaction  to  the  proposed 
OEH,  and  called  it  a big  step  forward  in  officer  evaluation. 

Inasmuch  as  the  writer  was  Initially  concentrating  on 
MBO  as  it  pertains  to  performance  evaluation,  it  was  only 
after  meeting  with  the  project  officer  at  the  Personnel  Eval- 
uation Systems  Office  that  its  intended  role  in  mission 
accomplishment  was  fully  appreciated.  Questions  directed  in 
subsequent  interviews  confirmed  that  most  officers  are  likely 
to  see  it  as  directly  supporting  that  objective. 

Another  point  reflecting  majority  but  perhaps  not  con- 
clusive agreement  related  to  special  assignments  in 


Seotlon  II,  Part  III,  of  the  t«at  form*  Although  one  senior 
officer  eonoBonted  It  mis  totjally  lnappli,o&blo  to  reservists, 
most  peroelved  it  as  having  value  in  the  event  the  officer 
mas  mobilized.  A majority  expressed  the  opinion  that  special 
instructions  should  be  included  for  reserve  components  to  the 
effect  that  this  portion  be  ooapleted  with  the  assumption  its 
impact  would  occur  after  mobilization. 

Effort  was  made  to  explore  the  impact  of  stability  in 
assignments  as  frequently  found  in  reserve  oomponents.  As 
suspected,  evidence  was  found  that  the  seoond  or  later  report 
on  an  officer  continuing  in  an  assignment  under  the  seuae 
rater  tends  to  represent  a summary  of  his  total  service  in 
the  position— -rather  than  being  strictly  related  to  the 
period  of  the  report.  The  evidence,  however,  was  not  con- 
clusive; moreover,  this  stability  appeared  not  to  occur 
generally  to  the  extent  experienced  by  the  writer  and  smie  of 
those  included  in  the  survey. 

Although  a Brigadier  General  whose  mobilization  assign- 
ment is  in  the  Office  of  the  Deputy  Chief  of  Staff,  Per- 
sonnel, Department  of  the  Army  was  included  in  the  survey, 
his  was  the  only  input  of  slgnifioanoe  from  a non-unit 
officer.  As  noted  earlier,  the  findings  are  thus  limited  to 
iaplioations  for  unit  officers . 

CONCLUSIONS 

The  findings  reported  point  to  the  oonoluslon  that 
the  proposed  OBS,  incorporating  the  oonoept  of  MBO,  and  the 
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rapoi*ting  Instrument  (DA.  Form  ?6)  are  applicable  for  use  In 
rassoPTe  units.  Moreorer,  those  concerned  with  the  larger 
queal^on  of  officer  acceptance  of  and  confidence  In  this 
concept  of  evaluation  will  flTid  encouragement  in  the  re- 
sults. 

Two  preceptive  captains  essentially  summarised  these 
oonoluslons  In  o<Muaents  recorded  on  their  questionnaires.  In 
oommentir^g  on  his  affirmative  answer  to  the  question  would  he 
like  to  be  rated  under  this  concept,  one  said  a great  deal  in 
the  following  short  statement:  "Much  fairer  method  and  gives 

the  rated  officer  a chance  to  tell  his  slde.'*^  The  other, 
a recent  Ph.D.  graduate  In  management,  said: 


I think  this  Is  an  excellent  way  to 
surface  talent,  performance,  and  lo- 
cate good  officer  personnel  for  pro- 
motion. I work  this  way  In  my  civilian 
Job  and  find  that  I can  accomplish  many 
tasks  Just  be  havi^  them  spelled  out  and 
listed  before  me. 35^ 
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APPENDIX  B - INITIAL  GROUP  INTERVIEW  QUE8TI0NNAIRE 


N«aa  & Bank 

Duty  Title  Component  

Organization 

Coneldaring  the  time  limitations  prerailing,  do  you  oon- 
eider  it  poeelble  to  implement  the  MBO  concept  In  the  OSR 
eyeten  with  USAB/NGUS  officers? 

Yes-- shsCbd  not  present  any  problem. 

Yes,  but  objectives  will  be  considerably  more  limited 
in  scope  than  for  active  officers. 

No— 'the  rater  just  doesn»t  have  the  necessary  obser- 
vation time,  and/or  the  time  required  for  the  com- 
munication process. 

Comment: 


Do  you  think  it  possible  to  set  objectives— at  least  with 
some  rated  officers— in  all  four  categories,  i.e.,  routine, 
problem  solving,  innovative,  personal  development? 

Yes  No 

Comment  t 


Do  you  see  a need  for  special  instructions  for  reserve  com- 
ponent raters  relating  to  the  special  assignments  section? 

— — 

Comment i 


Approximately  how  many  officers  have  you  rated  two  or  more 
times  while  the  rated  officer's  duty  assignment  remained  un- 
changed? 


About  what  percentage  does  this  represent  of  the  total  officers 
you  have  rated? 
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What  Is  the  graatast  nuabar  of  tines  you  have  rated  a given 
officer  serving  in  the  sma  oapaolty? 


Is  thidte  a need  for  weighting  second  and  later  OEB*s  of 
USAR/NGUt  officers  serving  In  the  same  oapaolty  uxider  the 
sane  rater? 

No 

Comnentt 


Wouj:  ju  like  to  be  rated  under  the  MBO  system? 

Yes  No 


Comment : 


Overall  reaction. 

Most  Favorable 

Unfavorable 


Comment  t 


Favorable 
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& 


Do  you  think  it  possible  to  set  obJectiTes-- at  least  for 
some  rated  offioers— *in  all  four  oategoriesi  i.e.,  routine, 
problem  solving,  InnovatiTe.  personal  development? 

Yes  No 

Comment  t 


The  Army's  Personnel  Management  Directorate  considers  the 
communications  process  between  rater  and  rated  officer  as  it 
leads  to  setting  objectives  to  be  the  essence  of  MBO. 
Considering  the  time  limitations  prevailing,  do  you  consider 
it  possible  to  Implement  this  concept  in  the  OEH  system  with 
USAR/NGUS  officers? 

Yes— should  not  present  any  significant  problem. 

Yes,  but  objectives  will  be  considerably  more  limited 

in  scope  than  for  active  officers. 

Yes,  but  the  comaiuni  cat  ions  process  will  largely  have 

to  take  place  outside  duty  hours. 

No,  the  rater  just  doesn't  have  the  necessary  obser- 
vation time  and/or  that  required  for  the  communi- 
cations process. 

Comment i 


a 

£ 


Do  you  see  a need  for  special  instructions  for  reserve  com- 
ponent raters  relating  to  the  special  assignments  section? 

Yes  ______  No 


Comment  t 


Approximately  how  many  officers  have  you  rated  two  or  more 
times  while  the  rated  officer's  duty  assigruient  remained  un- 
changed? 


Number 

35 


i 


About  idiat  poroentage  does  this  represent  of  the  total 
officers  you  have  rated? 


% 

What  is  the  greatest  number  of  times  you  have  rated  a given 
officer  serving  in  the  same  capacity? 

Number 

In  those  iiMSanoes  ^ere  you  have  rated  an  officer  twice  or 
more"  in "^he  same  capacity,  did  yotr  last  rating  tend  to  be  a 
summary  for  the  total  time  he  served  for  you,  or  did  you 
limit  your  observations  strictly  to  the  period  of  the  re- 
port? 


__________  A summary  Limited  to  last  reporting 

period 

Do  you  see  this  OER  concept— as  opposed  to  the  current  one- 
providing  the  rater/lndorser  with  a better  instrument  toi 

_________  Describe  the  rated  officer  and  how  he  has  per- 
formed. 

________  Use  as  ammanagement  tool, 

. Facilitate  unit  mission  accomplishment, 

________  None  of  these. 

Comment  2 


Would  you  like  to  be  rated  by  this  method? 
______  Yes  No 

Comment 1 


Overall  reaction. 

Most  Favorable  Favorable 

^Unfavorable 


Comment  s 
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